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I.  INTRODUCTION 


Information  analysis  is  a  useful  tool  in  the  characterization 
of  radar  system  performance.  This  type  of  analysis  was  first 
applied  by  Woodward  and  Davies  in  their  now  classical  study  of 
the  information-gathering  capabilities  of  matched-filter  radar 

•  1  2 
receivers  with  respect  to  the  range  parameters.  '  In 

modern  radars,  target  discrimination  plays  an  important  role,  and 
thus  the  consideration  of  other  target  signature  parameters  is 
necessary.  A  recent  study  of  the  extension  of  the  Woodward-Davies 
approach  to  more  general  parameter  sets  is  reported  in  Poor. 3  An 
important  aspect  of  this  problem  which  has  not  been  considered 
previously  is  the  treatment  of  time-varying  parameters.  Since  many 
of  the  parameters  of  interest  in  the  discrimination  mode  of  a  radar 
are  dynamical  in  nature,  the  study  of  such  parameters  in  that  con¬ 
text  is  of  interest. 

In  this  report  we  consider  the  application  of  the  notions  of 
continuous-time  information  theory  to  the  analysis  of  the  informa¬ 
tion-gathering  capabilities  of  radars  with  respect  to  dynamical 
parameters.  Section  II  presents  the  basic  definitions  of  interest 
in  this  problem  and  includes  a  discussion  of  the  earlier  studies 
of  radar  information  analysis  for  nondynamical  signature  parameters. 
In  Section  III  the  analysis  of  dynamical  signature  parameters  when 
observed  in  white  Gaussian  noise  is  considered.  Results  are  pre¬ 
sented  for  a  general  model  which  can  be  applied  to  parameters  such 
as  target  vibration.  Section  IV  considers  the  problem  of  charac¬ 
terizing  the  rate  at  which  radar  observations  generate  information 
about  parameters,  and  it  is  seen  that,  within  mild  restrictions, 
this  rate  can  be  determined  from  the  spectral  of  the  signature 
parameters.  A  discussion  of  several  extensions  of  this  work  is 
included  in  Section  V. 


1.  P.  M.  Woodward  and  I.  L.  Davies,  "A  Theory  of  Radar  Information, 
Phil.  Mag. ,  Vol .  41,  1950,  pp.  1001-1017. 

2.  P.  M.  Woodward,  Probability  and  Information  Theory ,  with  Applications  to 
P.adar,  McGraw-Hill,  New  York,  1955  . 

3.  H.  V.  Poor,  Information  and  Ambiguity  in  Millimeter-Wave  Radar: 
Characterization  and  Signal  Modeling ,  U.S.  Army  Missile  Command, 
Contractor  Report  TR-RE-CR-80-11,  M&S  Computing,  Inc., 

Huntsville,  Alabama,  January  1980. 


II.  BACKGROUND 


A.  The  Information  Theoretical  Model 


As  a  general  model,  consider  the  configuration  depicted 
in  Figure  1.  This  model  consists  of  an  "observation"  Y  which  is 
the  output  of  the  "channel"  resulting  from  the  input  "message"  X. 
Associated  with  the  message  X  is  a  quantity  of  information  denoted 
by  H(X)  and  termed  the  entropy  of  X.  Also  associated  with  X  and  Y 
is  a  quantity  of  mutual  information,  denoted  by  I(Y;X),  which  is 
the  amount  of  information  about  X  contained  in  Y.  This  latter 
quantity  is  also  known  as  the  information  gain  of  the  channel  and 
is  a  measure  of  the  information-gathering  capability  of  the  channel 
with  respect  to  X.  Thus  we  have  a  perfect  channel  if  I(Y;X)  =  H(X) 
and  a  useless  channel  if  I(Y;X)  =  0. 


As  an  example,  consider  the  finite-alphabet  case  in  which  X 
can  take  one  of  n  possible  values  {x^,  X2 , • . • ,  xn>  and  Y  can  take 

one  of  m  possible  values  {y^,  y2,...,  ym>.  The  probabilistic 

nature  of  X  and  Y  can  be  determined  completely  in  this  case  by 
their  joint  probability  mass  function  P  defined  by 

Al 

P  (x. ,  y.)  =  Prob  {X  =  x.  and  Y  =  y. };  i  =  i,2,...,n  (1) 

A*  Ij  X  J 

3  i^m*.  ,m. 


Similarly,  X  can  be  described  by  its  marginal  probability  mass 
function  Pv  given  by 


PX(xi)  =  Prob  {X  *  xi} 


PXY(xi' 


i 


1,2 


,n,  (2) 


and  Y  by  its  marginal 


Py(Y..)  Prob  {Y  =  y.} 


(3) 


For  this  situation  the  entropy  of  X  is  given  by 


H  (X)  =  - 


Px(xi)  log  [Px(xi) ] , 


(4) 


and  the  mutual  information  of  X  and  Y  is  given  by 

pxy  (xi'  ^ 


■  t 


PXY  (xi'  yj}  log 


i=i  D  =  J 


Px(xi)  PY(y.) 
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I ( Y;  X) 


(5) 


igure 


Similarly,  for  X  and  Y  continuous-valued  or  vector- valued, 

H (X)  and  I(Y;X)  can  be  defined  in  terms  of  the  joint  and  marginal 

statistical  properties  of  X  and  Y.  A  thorough  treatment  of  these 

.  4 

ideas  is  found  in  Gallagher. 

B.  Information  Analysis  of  Radar  Systems 

To  apply  the  model  of  Figure  1  to  the  radar  problem,  we 
consider  the  "message"  X  to  be  the  radar  signature  of  a  target  of 
interest  and  the  observation  Y  to  be  either  (a)  the  radar  return, 
or  (b)  the  output  of  a  radar  signal  processor.  Thus,  in  case  (a) , 
the  mutual  information  I(Y;X)  determines  the  total  amount  of 
information  available  about  the  radar  signature;  and,  in  case  (b) , 
I(Y;X)  measures  the  ability  of  the  radar  to  gather  this  information. 

The  first  application  of  these  ideas  to  the  radar  prob¬ 
lem  is  due  to  Woodward  and  Davies^-  in  which  the  quantity  X  is  the 
range  delay  of  a  target  and  the  observation  Y  is  the  output  from 
a  matched- filter  receiver.  Assuming  that  the  radar  return  is 
observed  in  additive  white  Gaussian  noise  and  that  the  range  delay 
,  is  uniformly  distributed  over  the  delay-gate  interval  [0,T], 
Woodward  and  Davies  showed  that 


I  ( Y;  X) 


|log  i 
(  (P2  +  ] 


’ log  (p  ST/  \fTne)  ;  if  AsO 

-l)/2-  log  (p  2 it )  ;  if  Asl 


where  p  is  the  signal-to-noise  ratio,  8  is  the  signal  bandwidth 
and  A  is  an  ambiguity  parameter. 


Two  extensions  of  the  Woodward  and  Davies  approach  are 
necessary  in  order  to  apply  this  analysis  to  more  general  radar 
problems.  The  first  is  to  apply  this  approach  to  more  general 
parameters  and  parameter  sets,  and  the  second  is  to  generalize 
the  approach  to  the  dynamical  case  in  which  the  parameters  are 
time  varying  within  the  observation  interval.  The  first  of  these 

3 

two  extensions  is  discussed  in  a  recent  report.  In  the  follow¬ 
ing  sections  the  second  extension  for  general  dynamical  parameter 
models  is  considered. 


4.  R.  G.  Gallagher,  Information  Theory  and  Reliable  Communication 

John  Wiley  &  Sons,  New  York,  1968. 


III.  INFORMATION  GAIN  FOR  DYNAMICAL  RADAR  PARAMETERS 


A.  I (Y;X)  for  Noisy  Observation  of  a  Random  Process 

In  the  discrimination  mode  of  a  radar,  many  signature  para¬ 
meters  are  time-varying  within  the  observation  interval.  Since  the 
dynamics  of  most  parameters  are  target  dependent,  this  dynamical 
behavior  might  be  exploited  to  improve  discrimination  performance. 
Thus,  we  would  like  to  generalize  the  adynamical  approach  dis¬ 
cussed  in  Section  II  to  the  dynamical  case.  To  do  so  we  assume 
now  that  the  signature  parameter  X  is  a  random  process,  i.e.,  that 

X  =  (X (t)  ;  0  <  t  <_  T}  (6) 

where  [0,T]  is  the  observation  interval.  We  also  assume  that  the 
observation  Y  consists  of  a  noisy  observation  of  X;  i.e. ,  we  have 
Y  =  { Y (t) ;  0  <  t  <  T}  where 


Y ( t )  =  X(t)  +  N(t)  ;  0  <  t  <  T, 


(7) 


and  where  {N (t) ;  0  ^  t  <  T}  represents  Gaussian  white  noise,  indepen¬ 
dent  of  X,  with  spectral  height  Nq. 

For  the  model  of  Equation  (7)  we  would  like  to  determine 
the  mutual  information  I(Y;X).  However,  the  determination  (or  even 
the  definition)  of  this  quantity  is  not  as  simple  as  for  the  finite- 
alphabet  case  noted  in  subsection  IIA.  The  treatment  of  informa¬ 
tion  theoretical  quantities  for  continuous-time  random  processes 

is  discussed  in  detail  in  the  book  by  Pinsker.^  The  reader  is 
referred  to  this  reference  for  details  of  this  analysis.  The 

model  of  Equation  (7)  has  been  studied  by  Duncan,^  and  it  can  be 
shown  that  for  this  case 


I (X; Y) 


/T 

|X(t)  -  X(t) 

0 


(8) 


where  E  {•}  denotes  statistical  expectation  and  where  X(t)  is  the 
minimum-mean-square-error  (MMSE)  estimate  of  X(t)  based  on  observing 
{ Y  (  t  )  ;  0  <_  x  <_  t}.  Note  that  it  can  be  shown  that  (see,  for  example, 

Wong7) 

X(t)=E{X(t)|Y(x);0_<T<_t}  (9) 

where  E { * | - >  denotes  conditional  expectation. 


5.  M.  S.  Pinsker,  Information  and  Information  Stability  of  Fandom  Variables 
■and  Processes,  Holden-Day,  San  Francisco,  1964. 

6.  T.  E.  Duncan,  ”0n  the  Calculation  of  Mutual  Information,"  SIAM 
•I.  -~apl.  Hath.,  Vol.  19,  1970  ,  pp.  215-220. 

7.  E.  Wong,  Fandom  Processes  in  Information  and  Dynamical  Systems,  John  Wiley 
*  Sons,  New  York,  1980. 


Equation  (8)  indicates  that,  for  the  model  of  Equation  (7) , 
the  mutual  information  I(Y;X)  is  one-half  of  the  normalized  mean- 
integrated-square  error  associated  with  the  MMSE  estimate  of  X(t) 
based  on  {Y(t);  0  <_  t  <_  t}.  The  problem  of  determining  these  latter 
quantities  has  been  studied  extensively  for  the  situation  in  which 
the  process  X  is  generated  by  a  stochastic  dynamical  equation.  A 

8 

summary  of  these  techniques  is  found  in  Gelb,  et  al.  In  the  fol¬ 
lowing  subsection  we  consider  the  application  of  the  formula  of 
Equation  (8)  to  the  specific  case  of  target  vibration. 

B.  Information  Gain  for  the  Vibration  Signature 

An  important  discriminant  for  surface-to-surface  radar 
application  is  the  vibration  signature  of  the  target.  It  has  been 
demonstrated  that  the  primary  effect  of  target  vibration  on  the 

9 

radar  return  is  to  produce  a  frequency  modulation.  Thus,  we  con¬ 
sider  the  observation  configuration  depicted  in  Figure  2.  Recall 
that  a  discriminator  is  a  device  which  extracts  frequency  informa¬ 
tion  from  a  waveform.  Because  of  imperfect  operation  of  the  discrimi¬ 
nator,  thermal  noise,  and  other  channel  noise,  we  may  assume  that 
the  discriminator  output  Y  =  {Y(t);  0  _<  t  £  T}  is  a  noisy  version 
of  the  target  vibration  process  X  =  (X(t);  0  <_  t  <_  T}.  Assuming 
the  white-noise  model  of  Equation  (7)  we  can  thus  compute  I(Y;X) 
for  the  configuration  of  Figure  2. 

The  vibration  process  X  can  be  modeled  as  a  superposition  of 
the  effects  of  the  various  vibrational  modes  of  the  target  result¬ 
ing  from  excitation  by  the  vibrating  source  (i.e.,  the  motor). 

Thus,  we  can  write 


X(t) 


Zi(t)  ; 


0  <  t  <  T 


(10) 


where  Z . (t) ;  i=l,2,...,n  are  components  due  to  the  vibrational 

resonant  modes  of  the  target,  and  the  c.;  i=l,2,..,n  are  weights 
reflecting  the  relative  effects  of  the  various  vibrational  modes 
on  the  waveform  modulation.  The  generating  mechanism  of  the 
vibrational  modes  can  be  modeled  as  a  linear  stochastic  multi-  T 

variable  dynamical  system;  that  is,  Z_(t)  =  [Z.(t)  ,  Z2 (t)  , . . . ,  Z  (t)  ] 
satisfies  the  vector  differential  equation* 


8.  A.  Gelb,  et  al Applied  Optimal  Estimation,  MIT  Press,  Cambridge, 
Massachusetts,  1974. 

9.  P.  M.  Alexander,  A  Theoretical  Analysis  of  Characteristic  Radar  C Canals 
from  Vibrating  Targets,  Technical  Note  No.  T-79-14,  Advanced  Sensors 

Directorate,  U.S.  Army  Missile  Research  and  Development  Command, 
Redstone  Arsenal,  Alabama,  April  1979. 

*  Note  that  a  superscript  T  denotes  transposition. 
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Figure  2.  Observation  model  for  target  vibration. 


dZ(t) 

-  =  A  Z  (t)  +  u (t)  ;  0  <  t  <  T  (11) 

dt  *  ”  “  ~  “ 

where  u(t)  is  the  vibration  driving  process,  and  the  system  matrix 
^  represents  the  model  response  of  the  target.  It  can  be  assumed 
that  the  driving  process  {u(t) ,  0  <  t  <  T}  is  a  vector  white  Gaussian 

process  with  zero  mean  and  autocorrelation  matrix 

E  {u(t)  uT  (s)}  =  Q  <5(t-s)  (12) 


where  Q  is  an  n  x  n  covariance  matrix,  and  5 (t-s)  denotes  the  Dirac 

'V 

delta  function.  We  may  also  assume  that  the  initial  condition  vec¬ 
tor  Z(0)  is  Gaussian. 

Note  that  our  observation  model  is  given  by 


Y(t)  =  cT  Z(t)  +  N  (t)  ;  0  <_  t  £  T  (13) 

where  cT  =  [c^,  c2,... ,cn].  Thus  since  X(t)  =  cTZ (t) ,  we  have  the 
MMSE  estimate, 

X(t)  =  E  {X (t) | Y (t) ;  0  <  x  <t} 

=  E  (cTZ  (t)  |Y(x)  ;  0  £  x  <_  t} 

=  CT  E  {Z  (t)  |  Y  (x )  ;  0  <_  x  <t>  (14) 

where  we  have  used  linearity  of  the  expectation  operator.  We  note 
now  that  the  guantity 

Z (t)  =  E  {Z(t) | Y ( x ) ;  0  <  x  <t>  (15) 

is  the  minimum-mean-norm-error  estimate  of  Z (t)  based  on 

{ Y  ( x ) ;  0  <  x  <  t),  which  for  this  model  [Equations  (11)  and  (13)] 

~  ~  10 
is  given  by  the  Kalman-Bucy  filter. 


Referring  to  Equation  (8) ,  we  have 


I  (Y;X)  = 


:)  \  2  dt 


! 


A r0  E  |/Ti x(t)  - x(t) 

=  Ej  f  (CT  Z  (t)  -  CT  Z(t)l2  dt  | 

=  yi—  E  |  ^  cT  [Z  (t)  -  Z  (t)  ]  [Z  (t)  -  Z  (t)  ]T£  dt | 


10. 


R.  E.  Kalman  and  R.  Bucy,  "New  Results  in  Linear  Filtering  and 
Prediction , .-.S’!E  J.  Sas-’z  Engineering,  Vol.  83D,  1961,  pp.  95-108. 
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(16) 


/T 

cT  £  dt' 

o 


where 


P(t)  =  E  {  [Z(t)  -  Z(t)  ]  [Z(t)  -  Z(t)]T}.  (17) 

Note  that  £(t)  is  the  error  covariance  matrix  for  the  Kalman-Bucy 
filter  and  thus  satisfies  the  matrix  Riccati  equation  ^ 


d£U) 

dt 


- « ?<« 


+  P (t)^T  +  g  -  N0_1  £<t)c  =T  l (t) i 


0  <  t  <  T 


(18) 


with  initial  condition  £(0)  equal  to  the  convariance  matrix  of  ZJO) . 
Note  that  A  is  from  Equation  (11),  Q  is  from  Equation  (12),  and 

Ng  is  the  spectral  height  of  the  white  observation  noise.  The  solu¬ 
tion  to  the  matrix  Riccati  equation  of  Equation  (18)  is  discussed 

in  Reference  8,  pp.  136-142.  Thus  we  see  that  Equations  (16)  and  (18) 
allow  for  the  computation  of  I(Y;X)  for  the  vibration  signature  model 
of  Equations  (11)  and  (13) . 

C.  Information  Gains  for  Other  Dynamical  Parameters 

Note  that  the  procedure  outlined  in  subsection  IIIB  can 
be  applied  to  any  parameter  which  has  the  dynamical  structure 
described  by  Equation  (11) .  Signature  parameters  are  normally  pre¬ 
sent  in  the  form  of  modulations  on  the  radar  return  and  dynamical 
models  such  as  Equation  (11)  for  waveform  modulation  have  been  studied 

extensively  (see,  for  example,  Snyder^) .  Note  also  that  vector 
dynamical  parameters  can  also  be  treated  in  this  manner,  as  follows. 

Suppose  that  X  =  (X(t)  ;  0  <  t  <  Tl  is  a  vector  random  process 
(say,  m  -  dimensional)  and  Y  is  a  vector  observation  process  given  by 

Y  ( t)  =  X(t)  +  N(t)  ;  0  <_  t  <_  T  (19) 

where  N(t)  is  a  vector  Gaussian  white  noise  (independent  of  X)  with 
autocorrelation  matrix 


E  {N  ( t)  NT(s)>  =  Nq  I  5  ( t-s)  (20) 

where  £  is  the  n  x  n- identity  matrix.  Then  it  can  be  shown  that  (see 
Reference  6) 


11.  D.  L.  Snyder,  The  State-Variable  Approach  to  Continuous  Estimation, 

MIT  Press,  Cambridge,  Massachusetts,  1969. 
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i  (Y; X)  =  2-4-  E 
*  0 

where 

X(t)  =  E  (X(t)  |Y  (t)  ;  0  <_  t  <  t}. 
If  we  have 


i  r« 


(t)  -  X ( t)  l1  [X ( t)  -  X(t)  ]  dt 


(21) 


(22) 


X(t)  =  £  Z  (t)  ;  0  ^  t  <_  T  (23) 

where  Z_(t)  is  generated  as  in  Equation  (11)  and  where  £  is  an  m  x  n 
matrix,  then  it  is  straightforward  to  show  that  I(Y;X)  will  be 
given  by 


I  ( Y; X) 


tr  {C  P(t)CT}  dt 


(24) 


where  £(t)  is  defined  by  Equation  (17)  and  tr  {•}  denotes  the  trace 
operator.  For  this  case  P(t)  will  be  given  by  Equation  (18),  with 
the  final  term  replaced  by 

No'1  S(t)  $  S(t)  (25) 

where  Ng  is  the  scale  of  the  observation  correlation  matrix  from 
Equation  (20) . 

The  observation  model  of  Equation  (7)  can  be  also  gener¬ 
alized  to  include  parameter  extraction  systems  with  feedback.  In 
particular,  we  can  consider  the  model 


Y (t)  =  <p  [Y0  t;  X  ;  t]  +  N(t)  ;  0  <  t  ^  T,  (26) 

where  Yg  =  {Y(t);  0  <_  t  <_  t}  and  where  <t>  is  an  arbitrary 

parameter  extraction  system.  The  presence  of  YQ  allows  feedback 

systems  (such  as  phase-lock  loops)  to  be  included  in  the  model. 

Note  also  that  <(>  can  be  a  nonlinear  functional  of  X  and  can  change 
with  time.  Here,  as  before,  (N(t);  0  <  t  <  Tl  is  white  Gaussian 
noise.  The  mutual  information  or  information  gain  for  this  extrac- 

12 

tion  system  can  be  shown  to  be 

I  (Y;X)  =  JT  E'  Pl ♦  [Y0S?  X;  S]  "  ♦  (YgS ;  s]]2ds  (27) 

0  0 

where 

>  [YgS ;  s]  =  E  (  t[YgS;  X;  s ]  ;  YQS  ]  .  (28) 


12.  T.  T.  Kadota,  M.  Zakai,  and  J.  Ziv,  "Mutual  Information  of 
the  White  Gaussian  Channel  With  and  Without  Feedback, " IEEE 
Trans.  Inform.  Theory, V  ol .  IT-17,  1971,  pp.  368-371. 
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Note  that  this  result  is  much  more  general  than  that  of  Equation  (8) . 
It  should  be  noted,  however,  that  the  exact  computation  of  Equation 
(27)  may  be  difficult  for  nonlinear  problems.  However,  if  X  is 
generated  by  a  dynamical  system  (linear  or  nonlinear) ,  the  expres¬ 
sion  of  Equation  (27)  can  be  approximated  by  considering  the 

extended  Kalman  filter."^ 
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IV.  THE  RATE  AT  WHICH  INFORMATION  IS  PRODUCED  BY  RADAR 
OBSERVATIONS 

A.  Introduction 

Suppose  again  that  the  signature  parameter  X  is  a  random 
process  {X(t);  0  t  <_  T>  and  that  the  observation  Y  is  a  random 
process  (Y(t);  0  <  t  <_  T}.  The  quantity  I(Y;X)  is  a  measure  of 
how  much  information  Y  contains  about  X.  Thus,  the  rate  at  which 
this  information  is  produced  is  given  by  [I(Y;X)/T],  To  get  a 
single  number  for  the  rate,  independent  of  the  length  T  of  the 
observation  interval,  we  can  consider  the  following  definition 
for  information  rate: 


R (Y; X)  =  lim 

Thus  R (Y; X)  is  a  measure  of  the  rate  at  which  the  radar  observation 
Y  produces  information  about  the  signature  parameter  X  and  will 
give  us  an  idea  of  how  long  we  must  observe  a  target  to  get  a  given 
amount  of  information  about  X.  In  this  section  we  consider  the  com¬ 
putation  of  R( Y; X)  for  some  general  observation  models. 

B.  Information  Rate  for  the  Vibration  Signature 


(29) 


Before  considering  the  information  rate  for  general  models, 
we  first  will  consider  the  vibration  signature  model  discussed  in 
subsection  IB.  Using  Equations  (16)  and  (29)  we  see  that 


R  (Y;  X) 


lim 


T 


T 


c 


£(t)  c  dt 


I- 


(30) 


Since  the  vibrational  mode  matrix  ^  of  Equation  (11)  represents  a 
passive  mechanical  system  (the  source  enters  the  system  through 
{u(t)  ;  0  <_  t  <_  T})  ,  the  vibrational  modes  { Z  (t)  ;  0  t  T)  will 
achieve  a  statistical  steady  state  as  T-*-°°,  and  the  error  covariance 
matrix  P(t)  will  become  constant  as  T-*-«.  In  particular,  we  will 
have 


lim  £(t)  «  l  (31) 

T  +  oo 

where  ^  is  the  solution  to  the  steady-state  Riccati  equation, 

£  =  -  nq_1  £  %  £T  £  .  (32) 

Here  Q  denotes  the  n  x  n  matrix  with  all  zero  entries. 

Using  Equations  (30)  and  (31) ,  we  then  have  that 

R  ( Y ; X)  =  * — rj—  CT  P  c  (33) 

*  kN0  “ 
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where  JjJ  is  from  Equation  (32).  Equation  (33)  can  be  written  in  a 
more  useful  form.  In  particular,  we  note  that  Equation  (33)  repre¬ 
sents  one-half  of  the  normalized  steady-state  Wiener  filtering 
error  for  the  model  of  Equation  (7) .  Expressions  for  this  error 
have  been  derived  by  several  authors,  and  the  error  is  given  for 

this  case  by  (see,  for  example.  Reference  11,  p.  43) 


log 


[1  +  Sxx  (u))/N0l  du» 


(34) 


where  Sxx(u>) 
X;  that  is, 
we  must  have 


S 


is  the  power  spectral  density  of  the  parameter  process 
xx(u>)  is  the  vibration  spectrum  of  the  target.  Since 
SXX^  =  SXX^-0))'  E<3uati°ns  (33)  and  (34)  give 


R(Y;X)  =  /  !og  [1  +  SXXU)/N0]  du> .  (35) 


Thus  the  rate  at  which  the  configuration  of  Figure  2  produces 
information  about  the  target  vibration  signature  is  given  in  terms 
of  the  vibration  spectrum  by  Equation  (35).  Note  that  the  measure¬ 
ment  of  vibration  spectra  of  radar  targets  has  been  studied  by 

Webb,  Emmons,  and  Curtis. ^ 

C.  A  General  Formula  for  Information  Rate 

Equation  (35)  gives  a  useful  formula  for  the  rate  at  which 
the  system  of  Figure  2  produces  information  about  the  vibration 
signature  of  a  target.  The  general  theory  of  the  information  rates 

of  random  processes  is  treated  in  detail  by  Pinsker.^  More  general 
observation  models  than  that  of  Equation  (7)  can  be  considered  in 
this  context,  and  in  this  subsection  we  present  a  generalization 
of  Equation  (35)  for  such  models. 

Assume  that  the  signature  and  observation  processes 
{ X  ( t)  ;  0  <_  t  <_  T)  and  {Y(t)  ;  0  <_  t  <_  T}  are  jointly  Gaussian  and 
are  jointly  and  individually  stationary.  Let  denote 

the  cross  power  spectrum  of  X  and  Y,  Sxx(uj)  denote  the  power 

spectrum  of  X,  and  SYY(w)  denote  the  power  spectrum  of  Y.  A 

spectrum  is  said  to  be  rational  if  it  can  be  written  as  the 
ratio  of  two  polynomials  in  ~  Processes  with  rational  spectra 
arise  naturally  from  the  conventional  finite-state  linear  models 
for  dynamical  parameters.  If  the  spectra  SXY,  Sxx  and  Syy  are 

rational,  then  the  rate  R(Y?X)  is  given  by  (see  Reference  5, 

pp.  181-182) 


13.  W.  E.  Webb,  G.  A.  Emmons,  and  R.  A.  Custis,  Measurement  of 
Vibration  Simatures  by  Means  of  a  CO  2  Laser  Radar,  Technical  Report 
RE-77-2,  Advanced  Sensors  Directorate,  U.S.  Army  Missile 
Command,  Redstone  Arsenal,  Alabama,  October  1976. 
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(36) 


I(Y?X)  “  2?  f  lo9  11  -  |rxy  (co)  |  ^  ]  do, 


where 


x  i  2  lSXY(u>)  ^  2 

rXY ( U,)  Sxx(w)  SYY(w) 


(37) 


The  expression  of  Equation  (36)  also  holds  when  the  condition  of 
rational  spectra  is  relaxed  to  a  more  general  condition  (see 
Reference  5,  pp.  182) . 

Equations  (36)  and  (37)  give  a  formula  for  the  rate  at 
which  Y  produces  information  about  X  in  terms  of  the  spectral  pro¬ 
perties  of  X  and  Y.  To  illustrate  this  result,  let  us  consider 
the  observation  model  of  Equation  (7) ;  that  is, 

Y  (t)  =  X(t)  +  N(t)  ;  0  <_  t  <_  T  (38) 

where  (X(t);  0  <  t  <  T}  and  (N(t)  ;  0  t  <  T}  are  orthogonal.  In 
this  case,  we  have 

I Sxy(u) | 2  =  Sxx 

and 

SyyM  »  Sxx(co)  +  SNfJ( <u)  , 


(39) 

(40) 


where  SNN(w)  is  the  spectrum  of  the  noise  process  {N(t)  ;  0  <_  t  <_  T } . 
Equation  (36)  becomes 


I(Y 


i  /*“  r  sxx(u)" 

-17  /  109  [1  +  sjrJa“- 


which  generalizes  Equation  (35) 


(41) 


l 
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V.  SUMMARY  AND  DISCUSSION 

In  this  report  we  have  considered  the  generalization  of  the 
Woodward-Davies  information  analysis  to  the  case  of  general  target 
signature  parameters  exhibiting  dynamical  behavior.  We  see  from 
the  results  of  Section  III  that  the  information  gained  by  radar 
observation  of  a  dynamical  parameter  can  be  computed  from  the 
underlying  dynamical  structure  of  the  parameter.  Similarly,  it 
was  demonstrated  in  Section  IV  that  the  rate  at  which  radar 
observations  produce  information  about  a  dynamical  parameter  is 
determined  by  the  spectral  properties  of  the  parameter  and  of 
the  noise  introduced  by  the  channel. 

A  number  of  potentially  useful  extensions  of  the  ideas  are 
presented  in  this  report.  For  example,  we  can  also  consider 
measures  of  the  value  of  a  given  parameter  as  a  discriminant 
between  targets.  Information  theoretical  measures  of  discrimina¬ 
tion  ability  (e.g. ,  the  I-divergence)  can  be  computed  using  tech¬ 
niques  similar  to  those  used  for  computing  mutual  information. 
Previous  work  relevant  to  this  aspect  of  information  analysis  is 

14  15 

found  in  two  papers  by  Schweppe.  '  Again,  the  dynamical  and 
spectral  properties  of  the  parameters  can  be  exploited. 

Other  useful  topics  of  interest  include  the  design  and 
implementation  of  experiments  for  the  determination  of  parameter 
dynamics  and  spectral  properties  and  the  study  of  the  signal 
processing  required  to  achieve  performance  near  the  fundamental 
limits. 


14.  F.  C.  Schweppe,  "On  the  Bhattacharyya  Distance  and  the  Divergence 
Between  Gaussian  Processes,"  Inform.  Control,  Vol.  11,  1967, 

pp.  373-395. 

15.  F.  C.  Schweppe,  "State  Space  Evaluation  of  the  Bhattacharyya 
Distance  Between  Two  Gaussian  Processes,"  Inform.  Control, 

Vol.  11,  1967,  pp.  352-372. 
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